In-Line Monitoring of Laser Welding Using a Smart Vision System

This paper presents a vision system for the in-line monitoring of laser welding. The system is based on a coaxial optical setup purposely chosen to guarantee robust detection of the joints and optimal acquisition of the melt pool region. Two procedures have been developed: The former focuses on keeping the laser head locked to the joint during the welding; the latter monitors the appearance of the keyhole region. The system feedbacks the joint position to the robot used to move the welding laser and monitors the penetration state of the laser. The goal is to achieve a continuous adaptation of the laser parameters (power., speed and focusing) to guarantee the weld quality. The developed algorithms have been designed to optimize the system performance in terms of the elaboration time and of accuracy and robustness of the detection. The overall architecture follows the Industrial Internet of Things approach, where vision is embedded, edge-based analysis is carried out, actuators are directly driven by the vision system, a latency-free transmission architecture allows interconnection as well as the possibility to remotely control multiple delocalized units

A novel optical apparatus for the study of rolling contact wear/fatigue based on a high-speed camera and multiple-source laser illumination

Rolling contact wear/fatigue tests on wheel/rail specimens are important to produce wheels and rails of new materials for improved lifetime and performance, which are able to operate in harsh environments and at high rolling speeds. This paper presents a novel non-invasive, all-optical system, based on a high-speed video camera and multiple laser illumination sources, which is able to continuously monitor the dynamics of the specimens used to test wheel and rail materials, in a laboratory test bench. 3D macro-topography and angular position of the specimen are simultaneously performed, together with the acquisition of surface micro-topography, at speeds up to 500 rpm, making use of a fast camera and image processing algorithms. Synthetic indexes for surface micro-topography classification are defined, the 3D macro-topography is measured with a standard uncertainty down to 0.019 mm, and the angular position is measured on a purposely developed analog encoder with a standard uncertainty of 2.9°. The very small camera exposure time enables to obtain blur-free images with excellent definition. The system will be described with the aid of end-cycle specimens, as well as of in-test specimens

Deep learning-based hand gesture recognition for collaborative robots

This paper is a first step towards a smart hand gesture recognition set up for Collaborative Robots using a Faster R-CNN Object Detector to find the accurate position of the hands in RGB images. In this work, a gesture is defined as a combination of two hands, where one is an anchor and the other codes the command for the robot. Other spatial requirements are used to improve the performances of the model and filter out the incorrect predictions made by the detector. As a first step, we used only four gestures

On-line 2D monitoring of rolling contact fatigue/wear phenomena in dry tests

We present the in-field use of a recently developed on-line, real time, optical monitoring system for bi-disk rolling contact tests on railway-wheel- and rail- steel disks, based on laser illumination and a high-speed camera. Qualitative, as well as quantitative information can be obtained by the use of specific indexes derived from the images using blob analysis. Monitoring the tests provides information about the initial transients of turning-crest removal, on the steady state reached, and on the dynamics of the surface in between. Blob anisotropy is a key element to draw information of the mechanisms governing this intermediate state

State-of-The-Art and Applications of 3D Imaging Sensors in Industry, Cultural Heritage, Medicine, and Criminal Investigation

3D imaging sensors for the acquisition of three dimensional (3D) shapes have created, in recent years, a considerable degree of interest for a number of applications. The miniaturization and integration of the optical and electronic components used to build them have played a crucial role in the achievement of compactness, robustness and flexibility of the sensors. Today, several 3D sensors are available on the market, even in combination with other sensors in a “sensor fusion” approach. An importance equal to that of physical miniaturization has the portability of the measurements, via suitable interfaces, into software environments designed for their elaboration, e.g., CAD-CAM systems, virtual renders, and rapid prototyping tools. In this paper, following an overview of the state-of-art of 3D imaging sensors, a number of significant examples of their use are presented, with particular reference to industry, heritage, medicine, and criminal investigation applications